Heavy - Tailed Distributions in CombinatorialSearchCarla
نویسندگان
چکیده
Combinatorial search methods often exhibit a large variability in performance. We study the cost prooles of combinatorial search procedures. Our study reveals some intriguing properties of such cost prooles. The distributions are often characterized by very long tails or \heavy tails". We will show that these distributions are best characterized by a general class of distributions that have no moments (i.e., an innnite mean, variance, etc.). Such non-standard distributions have recently been observed in areas as diverse as economics, statistical physics, and geophysics. They are closely related to fractal phenomena, whose study was introduced by Mandelbrot. We believe this is the rst nd-ing of these distributions in a purely computational setting. We also show how random restarts can eeectively eliminate heavy-tailed behavior , thereby dramatically improving the overall performance of a search procedure.
منابع مشابه
نمودار شوهارت ناپارامتری رتبه علامت دار با فاصله نمونه گیری متغیر
Nonparametric control chart based on rank is used for detecting changes in median(mean). In this article ,Signed-rank control chart is considered with variable sampling interval. We compared the performance of Signed-rank with variable sampling interval (VSI-SR) to Signed-rank with Fixed Sampling interval (FSI-SR),the numerical results demonstrated the VSI feature is so useful. Bakir[1] showed ...
متن کاملHow to Define Mean, Variance, etc., for Heavy-Tailed Distributions: A Fractal-Motivated Approach
In many practical situations, we encounter heavy-tailed distributions for which the variance – and even sometimes the mean – are infinite. We propose a fractal-based approach that enables us to gauge the mean and variance of such distributions. 1 Formulation of the Problem There are many practical situations in which the probability distribution is drastically different from normal. In many suc...
متن کاملOpen Problem: Restricted Eigenvalue Condition for Heavy Tailed Designs
The restricted eigenvalue (RE) condition characterizes the sample complexity of accurate recovery in the context of high-dimensional estimators such as Lasso and Dantzig selector (Bickel et al., 2009). Recent work has shown that random design matrices drawn from any thin-tailed (subGaussian) distributions satisfy the RE condition with high probability, when the number of samples scale as the sq...
متن کاملThe E ect of Heavy - Tailed Job Size Distributions on ComputerSystem Design
Heavy-tailed distributions, a.k.a. power-law distributions, have been observed in many natural phenomena ranging from physical phenomena to sociological phenomena. Recently heavy-tailed distributions have been discovered in computer systems. In particular the sizes (service demands) of computing jobs have been found to exhibit a heavy-tailed (power-law) distribution. Most previous analytic work...
متن کاملOn Max-sum Equivalence and Convolution Closure of Heavy-tailed Distributions and Their Applications
In this paper, we discuss max-sum equivalence and convolution closure of heavy-tailed distributions. We generalize the well-known max-sum equivalence and convolution closure in the class of regular variation to two larger classes of heavy-tailed distributions. As applications of these results, we study asymptotic behaviour of the tails of compound geometric convolutions, the ruin probability in...
متن کامل